Connections to SEM

Hover over the links for details on some connections. Dots indicate ‘special cases of’ the parent node. Undirected connections suggest equivalence (≡ on hover) or a more complex relationship (usually for more general/more complex models). Note this is for a quick reference, not an exhaustive one.

Overview

This shows SEM’s place both as a generalization of other techniques and as part of a broader set of tools with graphical models. Path analysis extends standard linear models to incorporate indirect effects and multiple outcomes, possibly at the same time. Latent variable modeling (including both continuous and categorical latent variables, the latter equivalent to mixture models) includes the poorly named CFA and EFA, even though they are equivalent except for some constrained parameters. Latent variable analysis is actually far more general and includes things like hidden Markov models, topic modeling etc., but which are not typically used in the SEM framework. SEM combines latent variable models with path analysis, and potentially includes many other models (e.g. some mixed models can be modeled as latent growth curves). SEM is part of a larger modeling framework, Pearl’s structured causal models, which includes Bayesian networks (though BN models don’t have to be applied solely to causal models), and can be seen as graphical modeling with causal implication. By network analysis I mean many other graphical models regarding directed, undirected or mixed networks such as ERGM etc. which aren’t normally considered under SCM. And finally, everything’s a graphical model of some kind.

Labels

Regression: standard linear model

GLM: generalized linear model

Mixed Model: generalized linear mixed model

Econometrics: econometric models like instrumental variable analysis, seemingly unrelated regression etc., i.e. not all of econometrics, which would include glm, links to mixed models etc., but those that would fall under path analysis more or less.

Path Analysis: includes mediation models as in Imai.

Confirmatory FA: Confirmatory factor analysis, typically employed with SEM specific programming tools.

Exploratory FA: what most probably refer to when they say ‘factor analysis’ without qualification. Includes common factor analysis.

Other LV models: Other latent variable approaches such as LDA, HMM, mixture models, NNMF etc.

Latent Variables: latent variable models (very generally)

SEM: structural equation models

POF: potential outcomes framework

SCM: structural causal models

Bayesian Networks: directed, undirected or mixed graphical models often with no causal implications

Network Analysis: a la centrality measures, cliques, ERGM etc.; often undirected and/or with no causal implications

Graphical Models: most models in one way or another

References